TIFR/HEP/04-02 



Constraining R-parity violating couplings using 
dimuon data at Tevatron Run-II. 



Subhendu Chakrabarti, Monoranjan Guchait and N. K. Mondal 

Department of High Energy Physics 
Tata Institute of Fundamental Research 
Homi Bhabha Road, Bombay- 400005, India. 



Abstract 

The dimuon plus dijet signal is analyzed in the top squark pair production at 
Tevatron Run-II experiment and the total event rate is compared with the existing 
dimuon data. This comparison rules out top squark mass upto 188(104) GeV for the 
branching fraction 100% (50%) of top squark decay into the muon plus quark via lepton 
number violating coupling. Interpretation of this limit in the framework of R-parity 
violating (RPV) SUSY model puts limit on relevant RPV coupling for a given top 
squark mass and other supersymmetric model parameters. If ~ 180 GeV we found 
that the RPV couplings are roughly restricted to be within ~ 10~ 4 which is at the 
same ballpark value obtained from the neutrino data. The limits are very stringent for 
a scenario where top squarks appear to be the next lightest supersymmetric particles. 
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The Minimal Supersymmetric Standard Model(MSSM) [1] is a theoretically well moti- 
vated and also a very strong candidate for beyond standard model(SM) physics. Although, so 
far, there is no experimental evidence of Supersymmetric(SUSY) theory, nevertheless, in all 
current and future high energy collider based experiments, looking for SUSY is one of the 
very high priority programs. The MSSM contains all SM particles in addition to their corre- 
sponding SUSY partners and at least two higgs doublets which are the ingredient to switch 
on the electroweak symmetry breaking mechanism to generate masses of all physical parti- 
cles. Lack of evidence in degeneracy of masses among particles and corresponding sparticles 
implies that SUSY is not a exact symmetry, it has to be broken. In MSSM, a mixing occurs 
among different chiral states of sfermions(/), superpartners of fermions(/). Since the extent 
of mixing is proportional to the corresponding fermion mass, m,f, naturally, the mixing be- 
tween the third generation of left and right handed sfermions, fa, fn becomes more stronger 
than the case of other two generations of sfermions [2]. As a consequence, there is a large 
splitting between the mass eigen states ti and t 2 (assume < m t - 2 ) of top squarks(SUSY 
partners of top quarks). Moreover, because of large Yukawa coupling, the soft SUSY masses 
m t L ' m t R rece i ve a significant corrections via the renormalization group equation [3] which 
results more splitting between the masses of i\ and t 2 states. Incidentally, it may happen that 
for a certain region of SUSY parameter space the lighter state of top squark, t 1: turns out 
to be the next lightest SUSY particle(NLSP), where the lightest neutralino, Xi, is assumed 
to be the lightest SUSY particles(LSP). 

The decay pattern of t\ is phenomenologically very interesting. In the R-parity conserv- 
ing(RPC) model a scenario where is heavier than the mass of the lighter chargino tu^±, 
the charged current decay mode of t\ via a b quark and xf 

ti - bxt (1) 

dominates. Otherwise, i\ mainly decays via the loop induced flavor changing neutral current 
decay mode [4], 

ti - cxi (2) 

and as well as via the four body decay mode into a b quark, LSP and two massless fermions, 

ti - bx°Jf (3) 

The competition between these two decay channels in absence of charged current decay 
mode, Eq. 1 mainly controlled by SUSY parameter space [5]. Along with all these decay 
channels, in the framework of R-parity violating(RPV) SUSY model, t\ can have also other 
decay channels via lepton number violating couplings of class X' i3 j, 

h^i + q (4) 

assuming baryon number violating interactions are forbidden. Here stand for the lep- 
ton(quark) family index. Of course, the search strategy of top squark in hadron colliders is 
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decided by the decay pattern of t 1 . In RPC SUSY model, the detailed study of top squark 
searches has already been presented in Ref. [6, 7, 8] where as the discovery potential of ti 
for RP V SUSY model are discussed in recent studies [9] . 

In RPV SUSY model, neglecting the masses of leptons and quarks, the decay width of 
t\ into a lepton and a quark solely depends, for a given RPV X' i3 j coupling, on the mass of 
t\ state and cos %, where % is the mixing angle between two chiral states and t^. As a 
consequence of this decay channel, in this model, the pair production of top squark is signaled 
by di-lepton plus di-jet without missing energy in the final states 1 . For a given luminosity, 
the total event rate, of course, depends on the branching ratio, e^ r =BR(ti — > £ + q) which is 
given by, 

Br(U ^l + a)- r *fo - 1 + q) (5) 

( 1 1 + q) ~ v& + + r fl (t! - ail) (5) 

Here r»(ii — > £ + q) stands for the total decay width of t\ in the RPV channel where 
as r R (ti — > all) presents the total decay width of i\ for all possible kinematically allowed 
channels in RPC model. Needless to say that for a given m^, e £ br is very sensitive to X' i3 j and 
cos% and as well as to the total decay width of tx in all accessible RPC decay channels of 
t\. However, the total decay width of t\ in all RPC channels depends on SUSY parameters, 
mainly sensitive to M2 - the SU(2) gaugino mass 2 , \i - the higgsino mass parameter and 
tan j3, the ratio of two vacuum expectation values required to generate masses of particles 
in the model. The pattern of e e br has been investigated in detail for a wide range of SUSY 
parameter space [9]. It is found that the RPV decay mode, Eq.4, is very competitive and 
dominates over the other two decay channels, Eq.2 which is loop suppressed and Eq. 3 which 
is suppressed because of its four body final state. Interestingly, for a substantial region of 
SUSY parameter space, this RPV decay mode dominates over these two decay modes even 
for a smaller value of RPV couplings A^ 3 -(~ 1CT 4 ) [9]. However, this is not the case when 
ti is allowed to decay via charged current decay mode, Eq.l, in the scenario ~ m~± i.e 

when ti is not the NLSP. In this scenario, the RPV decay channel requires large value of 
X' i3 j to make it competitive with the charged current decay mode [9]. 

We can argue that, if the RPV SUSY model be a viable model, then the signature of this 
model may be found through the top squark pair production which has comparatively larger 
cross section as t\ is likely to be the lightest colored sparticle via its decay channel Eq.4. The 
search prospect of t\ at Run-II in Tevatron experiment in the framework of RPV model has 
been discussed in detail in Ref. [9] for the class of A- 3j RPV coupling. The discovery potential 
of ti are thoroughly discussed in the dilepton plus dijet channel in a model independent way. 
The range of A- 3 - which can be probed for a given luminosity is also presented [9]. The 
present study is devoted to investigate the signal of t\ state in the di-muon plus dijet (/i/j, + 

1 In case of r lepton some amount of missing energy will appear because of the presence of v T from r 
decay. 

2 Assuming the gaugino mass relation M\ ~ M 2 /2 
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jj) channel because of the decay t\ — > fi + q via the lepton number violating RPV coupling 
X' 23 j. Eventually, a comparison is made between our predicted event rates with the existing 
preliminary data which was analyzed to study the signal of second generation of Leptoquark 
searches in DO detector at Tevatron Run-II experiment [10] with >/i =1.96 TeV. It is worth to 
mention here that in our earlier study, we analyzed the di-electron plus dijet final state from 
top squark pair production and its subsequent decay, t± — > e + q, via RPV coupling X' l3 j [11] 
and compared the predicted event rates with the existing dielectron data in DO detector 
at Run-I. The di-electron plus di-jet data was reported in the context of first generation of 
Leptoquark searches of which final state event topology is same as the final state containing 
di-electrons plus di-jets. We concluded from that study that rrif -220 GeV can be ruled out 
for 100% decay of t\ in the channel, Eq. 4. Moreover, in the framework of RPV SUSY model 
we excluded certain region in the — A' 13j - plane for a given SUSY parameter space [11]. 

It is interesting to note that for a long time RPV SUSY models has been known as a 
viable option which can provide models of neutrino mass [12]. These models have attracted 
special attention after the neutrino data confirms that the neutrinos are not massless [13]. 
Clearly, the parameters which participate in the process of neutrino mass generation in a 
given model can be constrained using neutrino data and obviously it will be model dependent 
prediction [14, 15]. For example, for a certain class of models where A^ 33 lepton number 
violating couplings are required to generate neutrino masses are restricted to be within the 
range of ~ 10~ 3 — 10~ 4 depending on the magnitude of soft breaking masses in RPC SUSY 
theory [15]. Certainly, these bounds are more stronger than the previous bounds prior to 
neutrino data [16]. Notably, our previous analysis in the ee + jj channel predicts upper 
bounds on the same set of RPV couplings which are at the same ballpark [11]. At Tevatron 
Run-II, the implications of these relevant RPV couplings has been studied in detail very 
systematically [9] . We notice that it is quite possible to find the signal of RPV SUSY if the 
RPV couplings are in the vicinity of these predicted bounds. This interesting observation 
motivates us to further extend our study in the //yu + jj channel in RPV SUSY model and 
similarly as before [11], examine the value of RPV coupling A' 23j - allowed by the existing 
dimuon data [10]. In the past, using Tevatron data there was a attempt to constrain squark 
and gluino masses [17] and RPV couplings [18] in the framework of RPV SUSY model. In 
the next section we describe our analysis and discuss our results with a summary at the end. 

At Tevatron top squark pair production takes place via qq, gg — > tit\ and the magnitude 
of cross section depends mainly on m~ tx [19]. The QCD correction enhances the cross section 
by ~30% roughly, although this correction depends on the choice of QCD scales Q 2 [20] 
which we set to Q 2 = s. In our calculation we used CTEQ5L parametrization for incoming 
parton flux. As explained earlier, focusing our signal to /i/x+jj final state which arises due 
to ti decay, t± — > /i + q via A^- RPV coupling we intend to compare total event rates of this 
final state with the existing Run II di-muon result [10]. The event generator PYTHIA [21] 
has been used to generate events from t\ pair production and then forcing t\ to decay in the 
t± — > /j, + q channel. The hadronisation effects with the initial and final state radiation has 
been considered during event generation. We have used PYCELL [21] for jet formation. Note 
that we have not performed any detector simulation in our analysis. We have used PYTHIA 
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mainly to find the geometrical and kinematic selection efficiencies for the set of cuts defined in 
[10]. Eventually, we obtain the signal cross section by multiplying selection efficiency along 
with all other detection efficiencies due to triggering, muon isolation and identification, jet 
reconstruction and tracking efficiencies as quoted in Ref. [10]. 

In our analysis we have applied the same set of kinematic cuts [10] on final state particles 
which are optimized mainly to suppress the SM backgrounds, particularly from tt, WW 
pair production and Drell-Yan process. The selection cuts are as following: (i) muons are 
selected if, p^- > 15 GeV,|r;| <1.9 and dimuon invariant mass M w > 60 GeV, muon isolation 
is confirmed by demanding £"0.4 — £"o.i < 2.5 GeV where i?o.4(o.i) is sum of the energy of 
the particles contained in a cone of size 0.4(0.1) in rj-(p space around muons. Note that 
we smear the muon momenta as done in Ref. [10]. (ii) jets are required to have E 3 T > 25 
GeV, \r]j\ <2.4 and two or more jets are accepted with AR =0.4, AR = V Arj 2 + A0 2 . The 
efficiency for jet reconstruction with E 3 T > 30 GeV is given to be greater than 96 ± 3% [10]; 
(iii) Dimuon invariant mass is demanded to be M w >110 GeV; and (iv) S T > 280 GeV 
where S T = J2 i= ^jjE l T . 

Cuts (i) and (ii) are basically the preselection requirements to select events. Selection 
cut (iii) is mostly to eliminate the background, mainly, from Z — > yu/x where the events are 
distributed around the Z-peak, and finally, selection criteria (iv) on scalar sum of visible 
transverse energy takes care of rest of the background cross sections. The number of signal 
events are: 

n sig = O^h^br^ac-L (6) 

Oi^ix is the top squark pair production cross section for v /s=1.96 TeV, e ac is the 
acceptance efficiency including tracking efficiency (0.78±.007) and jet reconstruction 
efficiency(0.96±0.03). In the data, tracking efficiency is obtained with a sample of trig- 
gered di-muon events from Z — > fi/i. It is found that there is a dependence of tracking 
effciency on muon directions. Because of this rj dependence tracking effciciency needed to 
be parameterised[10]. In our analysis we have used the same parametrization for tracking 
efficiency, which is about ~ 65%. The effective luminosity L = L.c, where c is the correction 
factor due to the trigger efficiency, muon identification and isolation efficiency [10]. With 
the correction factor, the effective luminosity turns out to be L =81.8 ± 9.1 pb~ x where as 
the measured luminosity is 104pb~ 1 . In the calculation of cross section limits we have used 
this effective luminosity along with its error. In Table 1, we present, for various choices of 
m^, accepted efficiencies (e ac ) which is basically kinematic selection efficiencies computed by 
PYTHIA after applying the selection cuts as described above, folded with jet reconstruction 
and tracking efficiencies. It is expected that the efficiencies increase with m^ as for higher 
values of mi muons and jets become more and more harder. 

Clearly, from the knowledge of o- tx i x} e ac ( see Table. 1) and L, the number of /iyU+jj 
events can be predicted using Eq. 6. It is reported [10] that there is only one event in the 
data and the estimated number of background events are to be 1.59±0.47; the uncertainties 
in background estimation are purely due to the systematic and statistical errors. Armed 
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with this information we attempt to find the cross section limits using the Bayesian method 
assuming flat prior cross section distribution for different choices of m^. In Fig.l, we display 
the limits of top squark pair production cross section by solid lines for various values and 
for two choices of e^ r =0.5 and 1. The dashed line represents the predicted theoretical Born 
level cross section multiplied by K-f actor (=1.3) [20] 3 . This figure clearly shows that the top 
squark mass upto ~ 188(104) GeV is ruled out for e^,=1.0(0.5). We want to emphasize 
here that the limits of as shown in Fig.l is completely model independent. The limiting 
values of top squark pair production cross sections as shown in Fig.l and Eq. 6 enable us to 
predict upper limits of e^ r for each value of m^. In Fig. 2, for various choices of m^, we present 
the maximum values of e^ r at 95% C.L, which are allowed by existing dimuon data. As for 
example, for 771^=100 GeV, the limiting value of top squark pair production cross section 
from data forbids e^ r -48%, otherwise top squark signal in this channel could be observed. 
The shaded region in Fig. 2 is excluded at 95% C.L and certainly, it is a model independent 
prediction. Clearly, for -180 GeV there is no limit on e^ r since event rate is negligible for 
smaller values of cross sections in this mass range. It is already mentioned that in a given 
model the branching ratio e% r is controlled by the model parameters. Recall that the decay 
width of the channel, Eq. 4, is very sensitive to A 23j RPV coupling and mixing angle % 
In addition to that the branching ratio, e^,, is also indirectly controlled by, mainly by M 2 , /x 
and tan /3, which actually determine the total decay width of t\ in all RPC decay channels. 
Hence, for a given SUSY parameter space the total decay width of ti in all RPC channels 
is fixed. Consulting eq.5 and for a fixed value of cos# f ~ one can obtain the limiting values of 
RPV coupling \' 23 j from the upper limits of e% r . Following this strategy, for the purpose of 
illustration, in Fig. 3, we display the excluded region in the — A' 23j - plane for two sets of 
values of tan/3=5(Fig.3a) and 30(Fig.3b) setting the SUSY parameters to M 2 = 130 GeV, 
fx = 500 GeV. The other SUSY parameters which are involved, but not very sensitive to our 
results are shown in the figure caption. This selected set of SUSY parameters determine the 
value of m~± =122(125) GeV; m^o =63(65) GeV. In each figure, we present excluded region 
for two nearly extreme values of cos #£=0.95 and 0.02. These figures indicate that the RPV 
coupling X' 23 j is bounded roughly by ~ 10 -3 — 10~ 4 for the region of parameter space where 
m i 1 ~ m xf an d tan/?=5(see Fig. 3a). For higher tan/9 case(=30), this limit turns out to be 
smaller approximately by one order of magnitude (see Fig. 3b). However, the limit becomes 
weaker for the scenario where m~ tx ~ m ^±, because of the fact that in this region, the decay 

mode, t\ — > b + xt opens up and dilutes the dimuon plus dijet event rate. The enhancement 
of RPV decay width with the increase of cos 6~ t value results more excluded region than the 
region for low value of cos Q~ t . On the other hand higher value of tan /3(=30) results enhanced 
loop decay width, Eq. 2, costing branching ratio in the RPV decay channel, which eventually 
exclude comparatively narrow region, as shown in Fig.3b. It is interesting to note that limits 
obtained from the present analysis in the t\ NLSP scenario for m~ tl -180 GeV are comparable 
to the limits obtained from the neutrino data. Needless to say that this conclusion is very 

3 Although the value of K-factor depends on the choice of QCD scales, but for the sake of simplicity we 
assumed it to be fixed. 
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much SUSY parameter space dependent and holds for that region of parameter space where 
top squark is light (S 180 GeV) and appear to be the NLSP. 

In summary, we have computed the top squark pair production signal cross section in 
the di-muon plus dijet channel and compared the event rates with the existing data in DO 
detector at the Tevatron Run-II experiment. This type of signal occurs in the context of 
RPV SUSY model in the presence of lepton number violating coupling X' 23 j which is assumed 
to be the dominant one. Our analysis rules out the top squark mass, £ 188(104) GeV 
in a model independent way for the branching fraction of top squark in the muon plus jet 
channel, e^ r =l(0.5)(see Fig.l). The top squark pair production cross section limits obtained 
from data for each restrict the value of e^.(see Fig.2). In the framework of RPV SUSY 
model, the upper limits of e^, can be translated to the upper limits of X' 23 j coupling for a 
given set of SUSY parameters. We found that our predicted limits on A^- are very close to 
the limits obtained from neutrino data for a certain region of SUSY parameter space where 
m~ tl behaves like NLSP and m h £180 GeV. 
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m k (GeV) 


Detection efficiency(%) 


100 


1.52 


120 


3.4 


140 


6.67 


160 


10.4 


180 


13.8 


200 


15.7 


220 


17.2 



Table 1: Di-muon plus di-jet detection efficiencies for various m t ~ 




Figure 1: The top squark pair production cross section limits using data at 95% C.L. for 
e% r =1 and 0.5(solid lines). The dashed line represents the theoretical prediction. 
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Figure 3: The excluded region(hatched) by di-muon data at 95% C.L. The SUSY parameters 
are: M 2 =130 GeV, /i=500 GeV, m- q =300 GeV, m- t =200 and A-terms=200 GeV. 
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